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REVIEW OF PROMOTION PROCESS FOR RESEARCH SCIENTISTS 





Introduction 


The need for a comprehensive review of the promotion process for research scientists was 
identified by the Assistant Deputy Minister of Science and the Director General of 
Personnel. A number of Regional Directors General also expressed some concerns with this 
process and an interest in being involved in this review. 


Background 


Promotions in the Research Scientist (SE-RES) are different from the majority of Federal 
Public Service appointments in that they are incumbent-oriented rather than position- 
oriented. The level of a position is based on the scientific accomplishments of the 
incumbent and changes to the position level occur as a result of the incumbent performing 
at the next classification level. 


Treasury Board policy on this process uses criteria established by an Interdepartmental 
committee and adopts a quota system whereby the percentage of research scientists that a 
department can have at a given level is limited to 20% for the SE-RES-03, 25% at the SE- 
RES-04 level and 5% at the SE-RES-05 level. DFO has a national Departmental Review 
Committee for Research Scientists and regional committees that are involved in the 
promotion process for research scientists. Candidates for promotion compete annually for 
the limited vacancies. 


Some concerns have been raised as to the criteria and processes used in the promotion 
process for research scientists in the Department. The perception is that the criteria used 
for promotions appear to be biased more towards scientific excellence rather than provision 
of service to the clients. Thus, scientists seem to be recognized and rewarded through the 
promotion process for their contribution to research aimed at their peers rather than the 
relevance of the research in an evolving service-oriented cuiiure. 
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The need for this review is also supported by the Audit Report on the Physical and 
Chemical Sciences Directorate which contained a recommendation for changes to the 
performance appraisal process for research scientists. The findings indicate that the current 
criteria used to evaluate performance may at times be incompatible with the service to the 
client philosophy. Since this issue was broader than the Physical and Chemical Sciences 
Directorate, it was determined that it would be broadened to a comprehensive review of the 
promotion process for research scientists in the entire Science Sector (memorandum from 
R. Bergeron to A. Silverman, May 19, 1992). 


Review Issues 


The following issues have been identified for review: 


iF: The promotion process for research scientists in DFO. 

‘ what criteria are used for selection and evaluation of candidates for 
promotion? 

~ do the criteria need to be changed? 

; are there direct linkages between the criteria and established annual 
Departmental objectives and priorities? 

% are the criteria related only to productivity and contribution of a scientific 
nature? 


are good communication skills and service to the client orientation reflected 
in the criteria? 

are departmental or federal standards applied? 

who selects candidates? 

who makes the final decision on successful candidates? 

are DFO program clients considered or involved in the promotion process? 
is there a peer group review in the selection and rating of candidates? 


+ * + #* 


2. The promotion process for other professional groups, particularly biologists 
(BI), engineers (ENG) and commerce officers (CO) within the Department. 
if what processes and criteria are »sed for promotions in other professional 
groups? 


: are there any other professional groups that need to be examined? 
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5. Promotion processes used in other science-based federal Departments, other 
jurisdictions (e.g. provincial government), the private sector and internationally. 


x 


how do DFO criteria and processes compare with other federal and provincial 
science-based Departments and the private sector? 


how do the rate of promotions and appeals compare? 


how is the promotion process conducted in other G-7 countries and Australia 
and New Zealand? 


4. Equity in promotional opportunities within the Science Sector. 


is the promotion process equitable? 

are the promotional opportunities equitably distributed in the various sections 
of the Science Sector? 

are the processes and criteria consistently applied? 

are the rates of promotions and appeals comparable? 

are promotional opportunities fairly available to employment equity groups? 


a Perception of DFO’s research scientists and other client groups. 


is the promotion process perceived to be equitable by research scientists, 
clients, management and bargaining agents? 

is the role of research scientists in DFO clearly defined and understood by 
themselves, clients and other DFO managers? 

are the processes and criteria used for promotions communicated to the 
research scientists? 

are they perceived as being fair? 

are they perceived as equitably assessing all relevant forms of scientific 
productivity? 

is client involvement necessary or appropriate in this process? 


6. Linkages between promotion process and previous Science Evaluations. 


is the relevance of the research to DFO objectives appropriately recognized 
and rewarded? 
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Te 


7 are there any linkages between findings of program evaluations and 
subsequent promotion decisions? 


Examine the possibility of making appropriate recommendations to Treasury Board 
Secretariat. 


Methodology 


The approach to the review will be as follows: 


x 


Document the promotion process for research scientists in DFO through interviews 
with Personnel and the Department Review Committee for Research Scientists; 


Analyze demographics on DFO’s research scientist population and rate of promotions 
by region and sections within Science Sector; 


Review a representative sample of historical personnel files of both research 
scientists who have been promoted and those not promoted to assess the application 
of established criteria; 


Review minutes or any formal documentation on the deliberations of the Department 
Review Committee for Research Scientists to assess application of established 
criteria; 

Conduct research into practices of other federal departments, other levels of 


government, the private sector and internationally; 


Consult with Treasury Board. Secretariat and Interdepartmental Committee on 
Research Scientists regarding the policy governing this process and classification 
standards for research scientists; 


Collaborate with an external, leading scientific expert in an advisory capacity to lend 
credibility to the review; 
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Conduct interviews with ADM, Science; DG, Personnel; Regional Directors 
General; Headquarters Directors General; Regional Directors of Science; chairman 
of the RES promotion board; and, Regional Directors of Fisheries & Habitat 
Management. 


Consult with a representative sample of research scientists, biologists and technicians 
from all disciplines, regions and levels to gather perceptual, qualitative data; 


Consult with selected internal clients (e.g. fisheries managers) as well as external 
clients; 


Consult with heads of pertinent Associations, Societies or other Science interest 
groups, 


Timeframe 





Initial meetings /telephone calls with ADM, Science; DG, Personnel; Chairman, RES 
Promotion Board; RDG, Pacific; RDG, Quebec and other interested parties to 
discuss proposed terms of reference; 

Gather quantitative information on demographics; 

Initiate research other groups and other departments/jurisdictions/private sectors’ 
promotion processes and criteria; 

Obtain promotion files and documentation from Departmental Review Committee 
for Research Scientists; 





: Revise and finalize terms of reference; 

: Schedule meetings with Regional Directors of Science, if necessary; 

; Schedule group interviews with selected research scientists and client groups; 

: Develop interview guide for various groups to be consulted; 
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: Travel - Vancouver, Nanaimo, Sydney, Winnipeg, Mont-Joli, Quebec City, Moncton, 
Halifax, St. John’s; 

x Conduct personal and group interviews with RDGs, Regional Directors of Science 
and Fisheries and Habitat Management, Fisheries Managers, Research Scientists, 
Biologists and Technicians, external clients; 

: Collect pertinent regional data; 

: Analyze regional personnel files; 





. Analyze information collected; 
< Produce first draft of findings; 
; Circulate first draft of report for comments; 





¢ Finalize report; 
id Produce Executive Summary for DM; 


Resources 


The review will be conducted primarily by Meena Trotman with assistance from a junior 
analyst from Consulting and Audit Canada. Gary Boyd of the Science Sector as well as 
Nelson Strang, IAE and Celine Cheah, OCG will provide advice as required. 
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The estimated expenditures are as follows : 


Travel/Accommodation : 


In-house salaries : 


Evaluation Manager (30 days) 
Consultant fees : 


Expert Advisor (5 days) 
Junior Analyst - CAC (20 days) 


Total 
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$ 5 000 


$ 8 250 


$ 2 500 
$10 000 


$ 25 750 
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Review of Promotion Process for Research Scientists 


GUIDE FOR INTERVIEWS WITH RESEARCH SCIENTISTS 


I.D. Sex 

Category Year Appointed 

Region At Max for Level? 
Age (at 1 Nov 92) Years/Months at Max 





Provide overview of study. 


Let person talk about who they are and what they do. 


General (5 min.) 


— 
° 


Can you talk about the link between your work and the Department’s mission and 
objectives (priorities). 


Probe : Annual links to department’s objectives & priorities. 


Rationale: Warm up - links to preliminaries and demonstrates level of awareness - 
of the Department’s mission and objectives. 
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. Is the role of research scientists clearly defined and understood? 


Yes: No Don’t Know _ No Response 





Rationale: To probe for their level of understanding of where they fit in the "big 
picture”. 


o: Who would you regard as being the immediate users of your work? How do you 
communicate with them? Who are the ultimate beneficiaries of your work? 


Rationale: 7 establish their awareness of who they regard as their clients. 
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+, What is your understanding of the promotion process in your Region? 
Probe : Sources of information about the process (how do you know about it?) 
Rationale: To establish their understanding of the mechanics of the promotion 
process. 
To determine whether there are communication difficulties in 
disseminating information on the process. 
a Do you have a clear understanding of the criteria which are applied in the promotion 
process? 
Yes No Don’t Know No Response 


Rationale: To establish their understanding of the criteria. 
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6. Do you feel that the criteria used in the promotion process adequately assess all the 
relevant forms of scientific productivity? 


Yes No Don’t Know No Response 


Rationale: To determine scientists’ perspective on whether they are being assessed 
on what they do. 


ae Would you say that the criteria reflect an appropriate balance between scientific 
excellence and service to the clients? 


Yes No Don’t Know No Response 


Rationale: . To establish link between assessments and the department’s mission 
and objectives. 
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8. In your opinion, what constitutes a good research scientist? 


Rationale: To obtain the scientists’ perspective on the kind of achievements that 
should be recognized and rewarded. 


9. Are those characteristics reflected in the criteria? 


Yes No Don’t Know ———No Response 


Rationale : To determine justification for changes to criteria. 
10. | How does this apply to yourself - Do the criteria reflect what you actually do? 


Yes No Don’t Know No Response 


Rationale: To determine whether they perceive that they are being assessed on 
what they do. 
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11. What is the link between your workplans, your assessment and promotions? 


Rationale: To establish link between assessments and promotions and the 
department’s mission and objectives as reflected in individual 
workplans. 

12. Do you feel that the process is fair? 


Yes No Don’t Know No Response 
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13. Are the criteria fairly applied? 


Yes No Don’t Know No Response 





Rationale: To determine perception of criteria. 





Interview Guide - Research Scientists 


Page 7 


Review of Promotion Process for Research Scientists 








(10 min.) 





14. Should the criteria be changed? If so, in what way? 


Yes No Don’t Know No Response 


Probe : service to the client; 
effective communications; 
informal advisory services to other scientists and clients; 
impact of resource constraints on productivity; 
supervisory obligations; 
recognition for seeking and obtaining non A-base resources; 
greater emphasis on scientific excellence. 


15. Do you think the promotion process should be changed? If so, in what way? 


Yes No Don’t Know No Response 
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16. In your opinion, should there be client involvement in the management of the 
promotion process? (e.g. RDG chairing the Departmental Review Committee?) 


Yes No Don’t Know No Response 


17. Are there any other items or issues not discussed that you would like to raise? 


Documents, data, reports referred to during Interview 
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GUIDE FOR INTERVIEWS WITH REGIONAL DIRECTORS GENERAL 





es (5 min.) 


Provide overview of study. 





(25 min.) 
1. Is the role of research scientists clearly defined and understood? 
Yes. No. Don’t Know. No Response. 
of Do you feel that the work done by research scientists in your region is relevant to the 


Department’s mission and objectives? How often do you assess the relationship? 


Yes. No. Don’t Know. No Response. 
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Who are their clients? 


~~ 


Rationale: To establish managerial perception of the research scientists’ clients. 





a (20 min.) 
4, What is the promotion process in your region? 
a: Do the research scientists themselves understand the process and criteria? 
es No. Don’t Know. No Response. 


Rationale: To identify any communication difficulties that may exist. 
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6. Do you feel that the process is fair and accessible to those concerned? 


Yes. No. Don’t Know. No Response. 


Rationale: To determine managerial perception of transparency of process. 


ff In your opinion, what constitutes a good research scientist? 


Rationale: To obtain the RDG’s perspective on the kind of achievemnets that 
should be recognized and rewarded. 
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8. Are those characteristics reflected in the criteria? 


Yes. No._ Don’t Know. No Response. 


Rationale: To determine justification for changes to criteria. 


9: Do you feel that the criteria used in the promotion process adequately assess all the 
relevant forms of scientific productivity? 


Yes. No. Don’t Know. No Response. 


Rationale: To determine managerial perspective on whether research scientists 
are being assessed on what they do. 
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10. | Would you say that the criteria reflect an appropriate balance between scientific 
excellence and service to the clients? 


Yes. No. Don’t Know. No Response. 


Rationale: To establish link between assessments and the department’s mission 
and objectives. 


11.‘ Are the criteria fairly applied? 


Yes. No. Don’t Know. No Response. 
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12. Is there equitable access to promotional opportunities across the various disciplines 
in the Science Sector (e.g. Ocean Sciences vs. Biological Sciences).? 


Yes. No. Don’t Know. No Response. 


Rationale: To determine managerial perception of any differences in promotional 
opportunities across the Science Sector. 


Interview Guide - Regional Directors General Page 6 


Review of Promotion Process for Research Scientists 





(10 min.) 


Rationale for following 3 questions : To determine whether there are realistic 
alternatives to the present process and criteria. 


13. Should the criteria be changed? If so, in what way? 


Yes. No. Don’t Know. No Response. 


Probe : service to the client; 
communication skills; 
informal advisory services to other scientists and clients; 
impact of resource constraints on productivity; 
supervisory obligations; 
recognition for seeking and obtaining non A-base resources; 
greater emphasis on scientific excellence 


Interview Guide - Regional Directors General Page 7 


Review of Promotion Process for Research Scientists 


14. Do you think the promotion process should be changed? If so, in what way? 


Yes. No. Don’t Know. No Response. 


15. In your opinion, should there be client involvement in the management of the 
promotion process? (e.g. RDG chairing the Departmental Review Committee?) 


Yes. No. Don’t Know. No Response. 


16. Are there any other items or issues not discussed that you would like to raise? 


Reports, data, documents referred to during interview. 
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GUIDE FOR INTERVIEWS WITH REGIONAL DIRECTORS OF SCIENCE 


s (5 min.) 





Is the role of research scientists clearly defined and understood? 


Yes. No. Don’t Know. No Response. 


Rationale: To determine managerial perception of where research scientists fit in 
the "big picture”. 


Do you feel that the work done by research scientists in your region is relevant to the 
Department’s mission and objectives? How often do you assess the relationship? 


Yes. No. Don’t Know. No Response. 


Rationale : To determine managerial perception of linkages between activities of 
the research scientists and the Departmental objectives and priorities. 
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K Who are their clients? 


Rationale: To establish managerial perception of the research scientists’ clients. 





4. What is the promotion process in your region? Have you established a regional 
committee similar to the Departmental Review Committee? Are peer research 
scientists (peer professionals for other groups) involved in the selection and rating 
of candidates? 
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a. Do the research scientists themselves understand the process and criteria? 


Yes. No. Don’t Know. No Response. 


Rationale: To identify any communication difficulties that may exist. 


6. Do you feel that the process is fair and accessible to those concerned? 


Yes. No. Don’t Know. No Response. 
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vf In your opinion, what constitutes a good research scientist? 


Rationale: To obtain the RD’s perspective on the kind of achievemnets that 
should be recognized and rewarded. 


8. Are those characteristics reflected in the criteria? 


eS: No. Don’t Know. No Response. 


_ Rationale: To determine justification for changes to criteria. 
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9. Do you feel that the criteria used in the promotion process adequately assess all the 
relevant forms of scientific productivity? 


Yes. No. Don’t Know. No Response. 


Rationale: To determine managerial perspective on whether research scientists 
are being assessed on what they do. 


10. | Would you say that the criteria reflect an appropriate balance between scientific 
excellence and service to the clients? 


Yes. No. Don’t Know. No Response. 


Rationale: To establish link between assessments and the department’s mission 
and objectives. 
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11. Are the criteria fairly applied? 


Yes. No. Don’t Know. No Response. 


12. Is there equitable access to promotional opportunities across the various disciplines 
in the Science Sector (e.g. Ocean Sciences vs. Biological Sciences).? 


Yes. No. Don’t Know. No Response. 


Rationale: To determine managerial perception of any differences in promotional 
opportunities across the Science Sector. 
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6 (10 min.) 





13: Should the criteria be changed? If so, in what way? 


Yes. No. Don’t Know. No Response. 


Probe : service to the client; 
communication skills; 
informal advisory services to other scientists and clients; 
impact of resource constraints on productivity; 
supervisory obligations; 
recognition for seeking and obtaining non A-base resources; 
greater emphasis on scientific excellence 


14. | Do you think the promotion process should be changed? If so, in what way? 


Yes. No. Don’t Know. No Response. 
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15. In your opinion, should there be client involvement in the management of the 
promotion process? (e.g. RDG chairing the Departmental Review Committee?) 


Yes. No. Don’t Know. No Response. 


16. Are you aware of approaches related to the promotion process in other organizations 
that may be appropriate to this Department? 


Rationale: To gather information from the Regional Directors’ broader 
perspective of approaches used elsewhere. 


17. Are there any other items or issues not discussed that you would like to raise? 


Reports, documents and data referred to during interview. 
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GUIDE FOR INTERVIEWS WITH REGIONAL DIRECTORS OF FISHERIES & HABITAT 
MANAGEMENT AND INSPECTION 





Provide overview of study. 





al (25 min.) 


i How does the research scientists’ work relate to what you do? 
2. Would you consider yourself a client of research scientists? 
Yes. No. Don’t Know. No Response. 
Interview Guide - Regional Directors of Fisheries & Habitat Mgmt . Page 1 
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a; Are you Satisfied with the level of service that you receive from the research 
scientists (timely and relevant)? 


Yes. No. Don’t Know. No Response. 


Rationale: To determine client satisfaction with the contribution of research 
scientists. 


4, Do you consider that DFO research scientists help accomplish the Department’s 
mission and objectives? 


Yes. No. Don’t Know. No Response. 


Rationale : To determine perception of relevance. of research... 
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>. In your opinion, what constitutes a good research scientist? 


Rationale: To obtain the RD’s perspective on the kind of achievemnets that 
should be recognized and rewarded. 


6. (Establish awareness of the criteria) Are those characteristics reflected in the 
criteria used in the promotion process? 


Yes. No. Don’t Know. No Response. 


Rationale: To determine justification for changes to criteria. 
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ff Do you feel that the criteria adequately assess all the relevant forms of scientific 
productivity? 
Yes. No. Don’t Know. No Response. 


Rationale: To determine client perception of whether research scientists are being 
assessed on what they do. 


8. Would you say that the criteria reflect an appropriate balance between scientific 
excellence and provision of service to clients? 


XS. No. Don’t Know. No Response. 


Rationale: To determine client perception of linkages between assessments and 
service to the clients. 
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9. Is there equitable access to promotional opportunities across the various disciplines 
in the Science Sector (e.g. RES vs BI, PC, EG)? 


Yes. No. Don’t Know. No Response. 





2 (10 min.) 
Rationale for the following 2 questions : To obtain recommendations from the clients. 


10. | Would you recommend any changes to the promotional process or criteria for 
research scientists? 


Yes. No. Don’t Know. No Response. 


11. In your opinion, should there be client involvement in the management of the 
promotion process? 


Yes. No. Don’t Know. No Response. 
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12. Are you aware of approaches related to the promotion process in other organizations 
that may be appropriate to this Department? 


Rationale: To gather information from the Regional Directors’ broader 
perspective of approaches used elsewhere. 


13. Are there any other items or issues not discussed that you would like to raise? 


Reports, data, documents referred to during the interview. 
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APPENDIX C 


Statistical Supplement: 
Responses to Interview Questions 
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Q 5 


Do you have a clear understanding of the criteria which are applied in the 
promotion process? 


BY LEVEL 





Q 6 


Do you feel that the criteria used in the promotion process adequatly 
assess all the relevant forms of scientific productivity? 


BY LEVEL 





BY REGION 





Q7 


Would you say that the criteria reflect an appropriate balance between 
scientific excellence and service to the clients? 


BY LEVEL 





Q 9 


Are the charecteristics you consider make up a good research scientist 
reflected in the criteria? 


BY LEVEL 










Q.10 


Do the criteria reflect what you actually do? 


BY LEVEL 





Q.12 


Do you feel the process is fair? 


BY LEVEL 





BY REGION 





Q_.13 


Are the criteria fairly applied? 


BY LEVEL 





Q. 14 


Should the criteria be changed? 


BY LEVEL 





Q. 16 


In your opinion, should there be client involvement in the management of 
the promotion process? 


BY LEVEL 





APPENDIX D 


Promotion Process in 
Other Federal Science Departments, 
Agencies and Private Sector 
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Agriculture Canada 


Agriculture Canada employs 795 research scientists in the Research and Food Production 
and Inspection Branches and at the Canadian Grain Commission. The promotion process 
is organized as follows: 


Promotion Review Committees 


Four separate committees exist to review promotion to each level, ie there is a committee 
which makes recommendations for promotion from RES-1 to RES-2, a committee for 
promotion from RES-2 to RES-3 etc. The Promotion Review Committees are chaired by 
a Director, and are comprised of Directors, a human resources advisor (non-rating member) 
and, for the RES-3, 4, and 5 committees, of senior scientists who also serve as in-depth 
reviewers. 


The normal procedure in Agriculture Canada is that Directors identify those scientists they 
feel meet the criteria for promotion. In cases where they feel that the scientist does not 
meet the criteria, they are expected to be prepared to discuss the matter openly with the 
scientist concerned. Promotion committees for each RES level use the Classification and 
promtion criteria of the Standard in arriving at their recommendations for promotion to the 
next level. Candidates are assessed on each of the major factors such as productivity, 
creativity, leadership, recognition and scope of decision making using the criteria for the 
RES-1 to RES-S levels. 


Senior scientists, as part of their role, conduct an in-depth review of the candidates against 
these same criteria and prepare a narrative report on each for presentation to their 
committee. The Guidelines state that the senior scientists may seek comments from 
whatever source they wish. In the end, the Review Committee assigns an overall rating of 
RES level 1 to 5 to each of the candidates based on the predominant rating assigned to the 
various factors. 


Each review committee decides on the recommendations for promotion to be brought 
forward to the departmental committee. For all promotion recommendations reviewed by 
the committees the chairperson is required to ensure that a detailed narrative report is 
prepared outlining the strengths and/or weaknesses of the scientist. 


The Departmental Committee 


The Departmental Committee reviews the recommendations made by the Promotion Review 
Committees and makes the final decision on approval of promotions. 


The Departmental Committee is chaired by the departmental representative on the IAC. 
Its membership includes the chairpersons of the 4 Promotion Review Committees, the 


Agriculture Canada (cont’d) 


Directors General of the Research Branch, a Human Resources Advisor and possibly 
representation from the Food Production and Inspection Branch and the Canadian Grain 
Commission. 


Unlike Fisheries & Oceans, at Agriculture Canada, the Departmental Committee does not 
evaluate the individual scientists proposed for promotion. Rather, the procedure is that the 
chairperson from each of the review committees presents a report on those proposed for 
promotion and discussion follows. 


In the event that a promotion is not approved by the Departmental Committee, the review 
committee chairperson who has brought the proposals forward is responsible for preparing 
a report detailing the Departmental Committee’s reasons. This report is sent to the 
candidate’s supervising director for discussion with the scientist. The report is expected to 
outline areas where the scientist will need to improve, but must not give the impression that 
achieving those improvements would necessarily guarantee promotion. Scientists are 
entitled to request additional information from chairpersons through their directors. 


In the event that the Interdepartmental Advisory Committee refuses any promotions or 
reclassifications, the departmental representative prepares a detailed report outlining the 
reasons for this as well as the areas in need for improvement. The report is sent to the 
supervising director for discussion with the scientist. 


Energy, Mines and Resources 


Energy, Mines and Resources employs approximately 471 research scientists in three sectors, 
the Geological Survey of Canada, the Mineral and Energy Technology Sector, and the 
Surveys, Mapping and Remote Sensing Sector. The promotion process is organized as 
follows: 


Sectoral Committees 


Each sector is responsible for conducting its own review of performance and considering 
recommendations for promotions and transfers to the RES sub-group. 


The process begins at the divisional level. After the issue of the annual call letter, Directors 
of scientific divisions meet with scientists and their supervisors to discuss promotion. 
Directors have the option of requesting a peer review committee to prepare non-binding 
advise on whether or not candidates meet the requirements for promotion to the next level, 
as well as advise on the order in which the candidates should be ranked. 


This information is presented to the sectoral committees which are composed of the ADM 
of the sector, Directors General and Directors of scientific divisions. The sectoral 
committees examine the dossiers of researchers recommended for promotion in terms of the 
Classification Standard. There is no mandatory set of procedures for arriving at 
recommendations for promotion. Providing they act consistently, the sectoral committees 
are permitted to decide for themselves what method of rating they use. The committees 
are instructed that they must not attach undue weight to any single criterion, and it is 
understood that each candidate is not expected to score highly on each of the criteria. 


Having reviewed the documentation the sectoral committees will either recommend 
promotion or determine that promotion is not warranted at that time. Where a sectoral 
committee elects not to propose a particular research scientist for promotion, the 
accountable manager will be informed, and this decision made known to the scientist’s 
immediate supervisor. Scientists who are not recommended by their sectoral committee are 
to be given an explanation and an opportunity to discuss the decision. 


The Departmental Committee 


The Departmental Committee is made up of the 3 sectoral ADMs, 4 Directors General and 
2 Directors drawn from the sectors. The Departmental Committee reviews all promotion 
and transfer recommendations submitted with full and complete documentation from sector 
committees, and decides whether a positive recommendation will be accepted. 


All dossiers are submitted to the Departmental Committee prior to its promotion meeting, 
and sectoral representatives on the Committee are expected to review the dossiers of 
scientists recommended by the other sectors in comparison to those of scientists they have 
recommended. 


At the promotion meeting the Departmental Committee does not repeat the ranking 
procedure which has been carried out at the sectoral level committees. The Departmental 
Committee relies on the ranking provided to it by the sectoral committees. Generally those 
scientists who have been ranked highest at the sectoral level will be recommended for 
promotion. However, since the number of persons recommended for promotion by the 
sectors usually exceeds the possible number of promotions, there will generally be more 
detailed examination of dossiers and performance appraisals at the "cut-off point" in order 
to arrive at consensus. 


Scientists are informed of the Departmental Committee’s decision by their divisional 
Director who discusses the Committee’s decision with them. 


Forestry Canada 


Forestry Canada employs approximately 219 Research Scientists who conduct research and 
disseminate findings in the area of forest production, forest protection (from fire, insects and 
disease), forest environment and forest utilization. 


Science activities are carried out in regional research institutions which focus on regional 
aspects of national problems, and in national institutes which focus their attention on more 
fundamental research of a national or generic nature. Results are then transferred to the 
forest sector. 


Forestry adheres to the criteria found in the Classification Standard. In terms of process, 
there are Regional/Institute Committees which are composed of the RDG and program 
directors and may also include senior research scientists. "These Committees are not 
decision making bodies but are responsible for assessing each candidate to ensure that they 
meet the necessary criteria and ensures that full feedback is given to each candidate under 
review. It also provides comments to the Departmental Committee which is chaired by the 
DG, Science & Sustainable Development and comprises of the RDGs, Institute DGs and 
selected senior scientists. Regardless of the regional recommendation, any scientist may 
decide to have his or her case reviewed by the Departmental Committee. 


Environment Canada 


Environment Canada employs approximately 194 research scientists who work primarily on 
Atmospheric Services and Conservation & Protection. Equal weight is given to the criteria 
as defined in the IAC guidelines. However, for the higher level RESs, scientific productivity 
and recognition are the key criteria. 


The promotion process is conducted by Service Committees and a Departmental Committee. 
These committees are responsible not only for the Research Scientists but also the Research 
Manager positions. 


The Departmental Committee is chaired by a Science Advisor who is perceived by the 
Research Scientist community as being impartial, fair and with a strong interest in science. 
This committee is comprised of the Service Committee chairs who represent the views and 
recommendations of line managers. It also has the Director General of Corporate Human 
Resources as a voting member. One senior Research Scientist at the RES-5 level from each 
Service employing a significant number of Research Scientists is also a voting member of 
this committee for a 3-year term. An attempt is made to select this senior RES to represent 
the range of scientific research disciplines within the Department. 


The Service Committees exist for the Atmospheric Research Directorate and Conservation 
& Parks. The DG of these services chairs the meetings and senior Research Scientists at 
the RES-5 level are also represented. If required, an additional line manager at the 
Director level sits on the committee to maintain Directorate or Regional balance. 


No external peer reviews are conducted. 


Health and Welfare Canada 


Health and Welfare Canada has 133 Research Scientists working in the Health Protection 
Branch (HPB), specifically in Drugs, Environmental Health, Foods, AIDS and Disease 
surveillance. 


A special Departmental RES committee comprised of Director Generals from HPB who 
recruit research scientists, the Head of Staffing and Human Resources Planning and is 
chaired by the Director General of the Foods Directorate. The committee reviews and 
approves all RES promotions and recruitments to the group. 


The Department follows the criteria outlined by the IAC and does not use a ranking system. 
Each committee member individually reviews appraisals prior to the departmental meeting 
and decisions at the meeting are based on verbal discussion of each recommendation. 


Upon approval by the IAC, a memorandum to all HPB staff is issued by the ADM 
announcing the upcoming promotions and notices of appointments are posted throughout 
the Branch. 
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National Defence 


National Defence employs approximately 566 Defence Scientists (DS) who engage in 
scientific research and development, scientific analysis, liaison and advisory functions. The 
DS Classification Standard is incumbent-oriented and the Salary Administration System is 
designed to provide a rate of salary progression commensurate with the way in which the 
employee is developing professionally. 


There are 8 levels in the DS sub-group. The employee’s state of professional development 
determines their level and is based on 3 criteria. The relative importance attached to the 
criteria depends upon the nature the work performed, the level and length of experience of 


the individual: 


(1) Effectiveness and Productivity in Scientific Research, Development and 


Analysis (SRDA) 


Effectiveness in this area is measured by the following sub-criteria: 


Expertise 


Creativity 


Productivity 


Recognition 


Impact 


The extent to which a scientist is capable of being a 
source of current, knowledgeable and dependable data, 
information, opinion and advice; 


The extent to which the scientist is the source of new 
theoretical or experimental approaches, new concepts or 
systems, or the adaption of existing techniques to novel 
situations; 


The quality, quantity and value of accomplishments and 
contributions to the Department through in-house work, 
or work as scientific authority in contracting-out and 
technology transfer activities. 


The extent to which the scientist’s accomplishments and 
contributions to SRDA are known to and accepted by 
peers, colleagues and superiors; 


The extent of the scientist has had an impact on the 
quality, scope or direction of departmental activities 
and/or added to scientific or technical knowledge; 


(2) Effectiveness and Productivity in Representational and Human Relations 


Activities 


This is measured by the scientist’s acceptance as a communicator, 
representative, advocate and negotiator in SRDA. The more important the 
matters and issues entrusted to the employee, the greater the significance 
attached to this criteria. This criteria is expressed to be of significance where 
the scientist in question is engaged in industrial liaison and technology 
transfer, scientific liaison with the Canadian Armed Forces, other agencies 
and countries, or is engaged in advisory functions or contracting out. 


(3) Effectiveness and Productivity in Managerial Activities 


The criteria recognize that the management of defence science involves 
planning and controlling diversified resources and providing leadership to 
other scientists, engineers and technologists. Effectiveness in managerial 
activities is measured by provision of leadership, handling of complexities, 
obtaining, motivating and evaluating staff, communicating in managerial 
matters and judgement. 


The promotion process at National Defence allows scientists to be accelerated or de- 
accelerated through these levels. 


OTHER AGENCIES 
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National Research Council (NRC) 


The NRC is mandated to conduct research into science and engineering and, in that regard, 
it’s reputation is dependent upon its’ maintenance of a high degree of excellence in both 
these fields. The NRC employs approximately approximately 1000 researchers which 
comprises about one-third of its total population. The emphasis is placed on basic research 
which is measured mainly by the level of professional development in that field as assessed 
by peer recognition. However, due to economic restraints and cutbacks, NRC is starting to 
focus its research in terms of service to Canadian industry, who are considered to be their 
major client. 


There are five levels of career progression for scientists in the NRC : 


Junior Research Officer 
Assistant Research Officer 
Associate Research Officer 
Senior Research Officer 
Principle Research Officer 
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This is modeled on the university system of researchers. The criteria used for promotions 
are : 


Quality of Research/Problem Solving 
Measured through peer judgement based on an assessment of conceptual originality 
and profundity, of practical difficulties overcome in the course of the work, and of 
the breadth of application, effectiveness and impact of the end product. 
Level and Extent of Scientific or Technical Knowledge 
Contributes to other factors but merits a separate assessment. 
_ Planning Ability 
The ability to identify and define resolvable scientific, engineering or technical 
questions of importance or to identify promising areas of investigation. Assessing the 
probability, and probable cost, of finding a solution is an important part of this work. 
Leadership 
This includes inspiring by personal example, the organization and coordination of the 


efforts of others, the generation of ideas to be pursued by others, the provision of 
appropriate advice, and the resolution of unexpected difficulties. 


National Research Council (NRC) 


Technology Transfer and Industry Liaison 


A large part of NRC’s mandate involves technology transfer and liaison with industry. 
Besides the production of papers and written reports, this includes the provision of 
advice to industry and government agencies, input to and management of Research 
and Development contracts, participation in seminars and conferences, and service 
on technical or standards committees. 


Peer Recognition 


Particularly in the higher ranks, a high level of peer recognition is frequently 
encountered. Measures used for this are : the level of demand for expert advice; 
participation in the work of, or taking important positions in, associations; assisting 
in thesis examinations, refereeing papers, or performing other editorial functions; the 
receipt of honours, awards, invitations to lecture, etc. 


Administration 


Any activity that increases the effectiveness of other staff members is particularly 
valuable. This can include program planning, serving on internal committees, 
arranging seminars or conferences, and so on. Such activity usually denotes higher- 
than-normal ability to cooperate with others and a broad knowledge of the Division’s 
activities. 


Atomic Energy of Canada Limited (AECL) 


The research arm of AECL employs approximately 207 research scientists. Almost all the 
scientific work carried out by AECL is of an applied nature; there is no longer any 
significant amount of free research currently under way. 


The promotion process for the 4 levels of research scientist is no different than that for their 
engineers. The scientist and his or her supervisor sit down at the beginning of each year 
and establish certain goals which are agreed upon and formalized. 


Decisions with respect to promotion to the next level are based upon the extent to which 
the agreed goals have been achieved. The system does, however, take account of the fact 
that a researcher’s achievements may be affected by the availability of resources necessary 
to complete the agreed-upon goals. 


Matters such as the number of publications a scientist has to his credit, or his international 
reputation are not criteria for advancement. 


Bell Northern Research 


Bell Northern Research (BNR) employs approximately 100 scientists who carry out applied 
research in the telecommunications field. Very little if any free research is carried out by 
BNR scientists. 


Decisions with respect to appointments and promotion are based upon the following 5 


criteria: 
(1) 
(2) 
(3) 


(4) 


(5) 


The decision-making scope and judgement expected of a scientist at that level; 
The scientist’s problem solving, analytical and technical competence; 


The scientist’s leadership impact (extent to which they will be expected to 
direct the work of subordinates and exert influence outside BNR); 


Whether the scientist meets the job requirements in terms of education and 
experience; 


Interpersonal skills and range of contacts. 


BNR’s criteria do provide the possibility of taking account of a scientists publication record, 
but it is emphasised that the primary criterion is the production of useful devises and 


products. 


Hydro Quebec 


Hydro Quebec employs approximately 140 scientists in 4 levels. The role of scientists within 
the organization is to carry out applied research relevant to the production, transmission and 
consumption of electrical energy, and to facilitate the transfer of technology and the sale of 
services to external clients. The objectives of research within Hydro Quebec are stated in 
a plan which is revised annually to reflect the research needs of the organization. 


Classification of scientists is based upon 4 criteria: 


(1) 


(2) 


(3) 


(4) 


Nature of Activities This criterion includes the nature and extent of activities, 
and the difficulty and complexity of assignments; 


Scope _ of Decision-Making Involves the freedom of action given by 
management to the scientist to carry out their assigned duties. This criterion 
takes account of the scientist’s independence, reliability and personal 
initiative; 


Results This criterion recognises the scientific and technological spin-offs 
generated by the scientist’s work. Results are assessed in light of the research 
program’s overall mandate to conduct applied research relevant to the needs 
of the organization; 


Professional Standing The scientist’s professional standing within Hydro and 
outside the organization are assessed by reference to their role on technical 
committees and in the transfer of technology, requests received for their 
technical expertise, their publications record, and awards and other honours 
received from outside Hydro Quebec; 


These criteria are applied to each of the 4 employment levels by a matrix which describes 
what is expected of incumbents at each successive level. The matrix is used by managers 
and Hydro Quebec’s classification committee to arrive at classification decisions. Scientists 
need not score highly on each criterion, but the committee arrives at an overall assessment 
of candidate’s qualifications. 


Spar Aerospace 


Spar Aerospace is a private sector satellite communications firm with close links to 
Canadian and U.S. aerospace agencies. The company employs approximately 350 engineers 
with various areas of technical expertise who engage in applied research. The company does 
not engage in fundamental research except by contractual arrangement with government 
departments such as the Department of Communications. 


Employees in the engineering field are involved in all phases of projects. This means that 
their involvement is not limited to research alone, but includes participation in design and 
development phases. 

There are 6 employment levels for engineers. The classification is incumbent-based, so that 
employees may progress through the grades without changing jobs. The employees level is 
linked to their level of responsibility. Performance appraisals are carried out annually, and 
salary increases are based upon 3 factors: 

(1) Number of years of job-related experience since leaving university; 


(2) An annual performance rating score; 


(3) | Recommendations from the engineer’s supervisor; 
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INTRODUCTION 


Scientists employed in government and laboratories generally fall into one of two broad 
categories: those who are expected to do research that generates new knowledge and, 
those who are expected to apply contemporary knowledge in the day-to-day 
management of public affairs or resources. 


Individuals in the latter group may be evaluated for promotion by the well known and 
virtually standard routines of performance appraisal. The employee is fully aware of the 
job description, is informed about what is expected in the way of performance, is 
promoted with good performance, and if not promoted, knows why. Advancement to 
a higher level frequently involves a competition and interviews of a short list of 
candidates. 


For scientists in the former group, who are expected to be creative, evaluation may be 
much more akin to the processes at universities where strong emphasis is placed on 
research productivity and performance in relation to the norms for the subject area of 
research. The usual "package" of research related information to be used in promotion 
decisions contains the candidates curriculum vitae which gives publications, awards and 
honours, and includes letters of reference from “arm’s length" external peers. 


PROMOTION AT UNIVERSITIES 


Universities (especially large ones) tend to be schizophrenic in their evaluations of 
research contributions. Faculty members in traditional disciplinary departments 
(chemistry, philosophy, physics, etc.) are evaluated for whatever research area they 
happen to have chosen to be good at, but those in applied fields (engineering, forestry, 
fisheries, etc.) are chosen not only for what they are good at, but also, whether the 
research they do has some relevance to the "problems" or "issues" in society. At 
universities excellence usually triumphs over relevance as a criterion for promotion, but 
where there is a shortage of excellence, relevance tends to come to the fore in the 
presentation by the Dean of a candidate for promotion. Other criteria, such as teaching 
and administrative service, are also involved in the decision to promote at universities, 
and these too are often given more prominence if the excellence and/or relevance are 
a bit weak. (Attachment A gives some typical university rubber edged guidelines. They 
are from the University of British Columbia and differ from those of other Canadian 
universities only in the choice of adjectives and adverbs.) 


When it comes to the crunch, excellence in research is the only sure way to promotion. 
Universities have recently been criticized for placing too much emphasis on research in 
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promotion decisions, but scholarly elitism remains the name of the game. The excellent 
treatise on the sociology of the "Reward system in British and American science" by Jerry 
Gaston (1978 John Wiley and Sons) spells out both the philosophy and the statistics of 
the way the system works. (e.g., In a sampling of 600 scientists, the average career 
production was 27.9 papers over 18.4 years. One quarter produced seven or less, one 
half 18 or less, three quarters 39 or less and only 28 of the 600 scientists produced more 
than 98 publications.) The community of researchers is global, the fundamental ethic is 
criticism as the way to truth. The profession of research is in many respects quasi- 
religious in its purported aspirations. The excellent teacher is known only to the 
perimeter of the campus, the excellent researcher has a global reputation, etc. 


Since the time Gaston’s book appeared, universities have responded to various pressures 
and have increasingly recognized teaching as well as contributions other than papers, 
such as patents and copyrights, and extension activities that reflect the transfer of 
knowledge and know how from the research laboratory. But still, the primary emphasis 
is on excellence and sophistication. A professor of engineering who develops a new 
kind of screwdriver may get rich but will not get promoted for it, but the professor who 
develops a new computer logic processor will get promoted as well as rich. 


In the university system great credence is placed on peer review mechanisms, though 
they are an endless topic of debate (for example, there have been controversies in the 
past few years in the United States, France and the United Kingdom). Nevertheless, 
peer assessment, both by internal processes (promotion committees) and from external 
referees is almost universally seen to be essential to the promotion process. 


PROMOTION IN GOVERNMENT LABORATORIES 


Much the same story may be told in government laboratories where individuals, tending 
to settle into what they are personally best at, are evaluated on a mixed set of criteria 
that includes excellence in research, relevance to the mission of the laboratory and 
service to the laboratory in administrative or extension roles. 


In recent years there has been a worldwide trend to place increased emphasis on 
relevance of the research to the mission of the governmeiit organization and the tangible 
benefits to society that might or did ensue from application of the research findings. 


‘Promotion Process for Research Scientists in Other Countries 


At the same time there has been a trend to more precise articulation of the criteria for 
promotion and development of more elaborate procedures of evaluation. If all 
researchers are expected to perform both research and service roles and if research 
counts for more than service, the employee must know by how much, so that effort may 
be apportioned in relation to the rules of the reward system. And if the employee is 
hired to be a research scientist, then the criteria should be weighted so as to ensure that 
a substantial research productivity is essential for promotion. 


These trends lead inevitably to a performance appraisal system that is similar in form 
to that for non-research scientists, but which has different criteria for promotion. 
Attachments B and C spell out the general approach. 


Among the countries and institutions for which material is attached, the Commonwealth 
Scientific and Industrial Research Organization of Australia seems to have gone furthest 
in this direction. 


The major shortcoming of these systems according to their critics, is that a great deal 
depends on the local laboratory head. The criteria, the expectations and the performance 
may all be "fudged" to some extent so that the complex, time consuming performance 
appraisal is just a charade to disguise subjective assessments. Everyone knows which 
research scientists are worth promoting on their research merit and all the rest is simply 
a way of making a case for those of borderline merit. 


The major advantage of these systems, according to their proponents, is that they are fair 
and forthright, the facts are all on the table and employees clearly understand what is 


expected of them. 


The following sections sketch the criteria and procedures for research scientists in 
various countries and institutions. 


AUSTRALIA 


The Australian Commonwealth Scientific and Industrial Research Organization has 
recently developed a comprehensive "performance planning and evaluation program" 
which is built on the premise that advancement should be based on the satisfactory 
achievement of agreed work objectives and competencies. The program covers a full 
spectrum of "functional areas" (such as "research management", "research 
scientist/engineer", "research projects", "technical services") and for each area there are 
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defined two or three "critical competencies" and five "elective competencies” of which 
three are chosen by the employee in consultation with management. (Attachment D 
page 12). 


Thus for a research scientist/engineer, the critical competencies are “application of 
knowledge", "problem solving" and research innovation" and the elective competencies 
are “adaptability”, "communication", "independence", "judgement" and "resource 
management". 


For each functional area there are several "levels". For the research scientist/engineer 
area, levels five to eight describe progressively higher degrees of performance in each 
of the competencies. (Attachment D,, page 1.) 


Throughout the system, promotion is on merit, not on the basis of establishment 
positions. All staff are reviewed annually. A "case" for promotion may be made by an 
individual or supervisor, but is usually written in collaboration. Approval is at the 
divisional level. The whole system builds on a single salary structure where there were 
at one time 23 structures. 


The performance evaluation is critically dependent on the setting of the agreed objectives 
against which performance is to be measured. The objectives are in two sets a) work 
objectives (what is to be done) and b) competency objectives (how to improve oneself). 
Performance as measured by publications per se is downplayed. Citation indices are not 
used. Industry acknowledgement of value of the work is critical. Some consideration 
may be given to international reputation and overseas invitations, but, in general, the 
new system is strongly oriented to results that are immediately tangible and applied. 


A scheme that had been developed by the Wildlife and Ecology Division of CSIRO and 
presumably has now been replaced by the new performance evaluation, is worth 
comment as a somewhat elaborate system of assessing merit for promotion. A "Research 
Accountability Score" is computed from material provided by the scientist to a review 
committee which estimates: 


Research Accountability = (SP + RE + C)/5 


Where SP = Scientific Publications Maximum score of 20 
Where RE = Research Effect Maximum score of 20 
Where C = Communication & Commitments Maximum score of 10 
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Promotion Process for Research Scientists in Other Countries 
With respect to the SP component, the scientist provides a list of publications for the 
previous five years, self assessing points as follows: 


0.5 Technical memoranda, internal reports of substance, manuals for software, 
unpublished, unrefereed conference papers 


ik Short papers on externally refereed reports of minor importance 
re Papers in recognized good journals 

3. Papers of major importance, editor of a book 

10. Chapter of a book 

15. Substantial book 


Fine print covers such matters as joint authorship and papers unrelated to the scientist's 
program objectives. The sum of the publication scores is place into one of 21 classes (0- 
20) based on class intervals of 2.5 to give a score ranging from 0 to a maximum of 20. 
Thus, a scientist who wrote a book (15), a chapter of a book (10) and three good papers 
(9) and five technical memoranda (2.5) would receive an SP score of 15, being in the 14th 
class interval of 35 to 37.5 points. 


The Research Effect score is based upon: 


1. The Science (or Social Science) Citation Index for the previous two years, roughly 
associating 5 citations per point up to 10 citations, 10 per point up to 50, 25 per 
point up to 100 and, 50 per point beyond 100, with a maximum of 10 points. 


pa A maximum of 10 points based on a statement with dates of the "significance of 
the research”, i.e., "how it has influenced either policy or resource management, 
or how it has applied in other ways for the benefit of society on the national 
interest". "Unsupported general statements and statements attending to the 
potential or future value" are not considered. There is further fine print! 


The Communications and Commitments score is based on services on committees, minor 
reports, lectures and training activities, reviews of manuscripts and administrative 
duties, also spelled out with fine print. 


All of the above is overseen by an inhouse technical committee (for which the committee 
members presumably get credit!). 


Promotion Process for Research Scientists in Other Countries 


This system may seem like the invention of an overzealous clerk, but it has the merit 
(typically Australian) of being forthright and transparent. If you do not get promoted, 
your surely know why! 


The other "bottom line" of this whole exercise is that operating funds for research 
programs are allocated in large measure (75 to 80 percent) according to their proportion 
of the sum of the Research Accountability scores. 


Attachment D, gives more detail. 


UNITED STATES 


For research positions in the National Marine Fisheries Service (NMFS) of the National 
Oceanic and Atmospheric Service (NOAA) of the United States, evaluation is based on 
a Research Grade Evaluation Guide (Attachment E) which recommends evaluation in 
relation to four factors: 


1.: Research situation: nature, scope, complexity, challenge. 


z Supervision received: degree of freedom in choosing course of action, finality of 
recommendations 


3. Guidelines and Originality: Creativity and judgement, insight, resourcefulness, 
impact of studies 


4. Qualifications and Scientific Contributions: Total Qualification, professional 
standing, recognition, particularly as they impact on the job. 


Each of the first three factors are scored either 2,4,6,8, or 10 and the fourth is double 
weighted and scored 48,12,16 or 20. The score is then translated into a GS grade (5 to 
15) by reference to "Grade-Determination Chart" (Attachment F). Grades 5-9 are 
technical rather than research oriented and need not concern us here. Grades 11 to 15 
are relateu/correspond to scores as follows: 
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Grade Score 
GSI11 8-12 
GS12 16-22 
GS13 26-32 
GS14 36-42 
GS15 46-52 


Where the scores fall between the ranges given it may be assigned to the Grade above 
or below based on considerations not covered in the four factors. 


Procedures vary within and between agencies. The Evaluation Guide recommends 
panels comprised of researchers from a variety of disciplines and professional "position- 
classifiers". The change over time that often occurs in research positions is recognized 
and periodic review is recommended. 


The Environmental Research Laboratories of NOAA have one of the most formalized 
procedures for evaluation (Attachment G) and relates GS11-15 to university ranks as 
follows: 


Grade Rank 

GS11 Instructor 

GS12 Assistant Professor 
GS13 Associate Professor 
GS14 Senior Professor 
GS15 Professor 


Letters may be sent to university referees asking "at what rank would this person be in 
your institution?” 


Both NMFS and NOAA recognize that on rare occasions a "research star" exceeds all 
others in GS 15 by a wide margin, and just as universities name a few "distinguished 
professors" so are few government research scientists given special recognition. 


NOAA is currently working on developing procedures to be used by all NOAA agencies 
(Attachment H). 
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NEW ZEALAND 


Because it is a relatively small country, New Zealand can have a single nation wide 
competition for promotion for fisheries research scientists. Every two years, scientists 
are required to outline their duties and achievements (Attachment I) and can make a 
request to appear before the rating panel. Regional and Centre Managers are required 
to rate the scientists in one of four categories (Attachment J) 


A Promotion recommended 
B Promotion not recommended but expected to progress in time 
C Performance to improve before promotion 


D Unsatisfactory performance 


Those in category A and the upper half of category B must be placed in order of priority 
for promotion. 


The dossiers of all of the scientists are reviewed by a panel of five comprising the 
managers of freshwater and marine research and three regional managers (i.e., all the 
top brass). The panel assesses merit and priority for promotion (Attachment K) on the 
Basis of: 


Technical competence 

Management competence 

Personal characteristics and attributes 
Educational and professional achievements 


AON 


A selection of scientists is interviewed by the panel to establish "bench mark" positions. 
There is no fixed number of positions at various grades. 


UNITED KINGDOM 


The system in the United Kingdom accords to a standard performance appraisal model, 
heavily laden with Trade Union type of contractual language. Candidates for promotion 
are reviewed annually by a panel of three or four. for the Scientific, Professici.al and 
Technical Grades members of the panel must have appropriate technical knowledge and 
themselves be at least at an equivalent or near equivalent grade. 
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we off 


Evaluation focuses on "personal qualities", "approach to work", "communication skills", 
"management skills" and "technical skills”. 


Candidates for promotion have the right to ask for an interview, appeal a decision and 
register a grievance. The Trade Union may make representation to the panel. There are 
a fixed number of positions so that a person may be recommended for promotion but 
will not be promoted until a position becomes open. 


Attachments L, M and N describe the system, which has nothing to commend it that I 
can see. 


CGIAR 


The Consultative Group for International Agricultural Research (CGIAR) is an informal 
consortium of donors (one of which is Canada) that supports 18 international research 
centres of which 13 are agricultural commodity based (e.g., the International Rice 
Research Institute that inspired the "green revolution") two are concerned with forestry, 
one with fisheries and two with policy. The centres vary in size with professional staff 
complements ranging from 15 to 150. In many respects they have similar missions to 
national research agencies of developed countries in that the emphasis is on long term 
mission oriented activity. 


The centres of the CGIAR system do not have a system wide set of guidelines or criteria 
for promotion and remuneration of scientists who have various mixes of research and 
administrative responsibility. Nevertheless, the continuing dialogue among the Centre 
Directors-General and Board of Trustees has brought about some measure of uniformity 
in both levels of salary and benefits packages. Bearing in mind that there are trade-offs 
between salary and benefits, differences in pay scales for nationals and expatriates, and 
that most scientists in their institutions are employed on renewable short term contracts, 
comparisons of their salary levels with those of Canadian scientists in government 
laboratories are not readily interpreted. 


Guidelines for evaluation of scientists in purely research roles in the centres generally 
place emphasis on both excellence and relevance. For example: 
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1. Publications (having regard to sole or senior authorship, vehicle of publication, 
amount of repetition, etc.) 


2. Citation and impact indices (interpreted with due regard to the shortcomings of 
systems of compiling article citations and assessing scientific impacts) 


S Awards and honours for research achievements 

4. Invitations to conferences, workshops, seminars, etc. 
For Relevance: 

1. Relevance to the mission of the Centre 


2. Applications of the research benefits to the target group of clients (for many of 
the centres the target group is the rural poor of the developing countries) 


3. Patents and other proprietary rights (frequently held by Centres or funding agents 
for royalty free use in developing country agencies.) 


One of the more progressive centres, the International Centre for Research in the Semi- 
Arid Tropics (ICRISAT), depends heavily on formalized job descriptions and yearly 
measurement of performance in relation to goals that were set in discussion with the 
employee the year previous. It is a fairly highly structured organization with a set 
number of positions for each of the various roles that are to be performed. The system 
is said to have the great merit of being very fair and forthright but may become too 
rigid. 


This sort of approach is being encouraged by the secretariat of the CGIAR who express 
the view that traditional procedures of evaluation may have demoralizing effects on 
scientific staff, especially if the procedures are secretive and arbitrary. When the 
purpose of evaluations is to motivate researchers to higher levels of achievement they 
can be valuable instruments of personnel policy. This theme is well developed in 
Appendices B and C, which are being recommended to Centres for their consideration 
and were in fact written by staff of one of the CGIAR Centres, the International Service 
for National Agricultural Research. 
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In recent years the appointments of Directors General for centres have placed more 
emphasis on administrative and managerial skill than on scientific ability and 
performance. There are several possible explanations, including some experiences of 
poor management in countries where lack of infrastructure and political turmoil are 
chronic problems. In such circumstances, Directors General need managerial skills more 
than research sophistication. 


GERMANY 


The reward system in Germany is strongly tilted in the direction of research 
productivity. Initial appointments are based on interviews and applicants are judged 
70 to 80 percent on the quality of their science and 20 to 30 percent on the potential for 
research management. Appointments are virtually "contracts for life". With strong 
research performance, a scientist may "rise" to the level of Deputy Director of an 
Institute, through 13 to 15 grades. Every two years, salaries are increased 2 percent, 
automatically within a grade but subsequently only on promotion to a higher grade. 


Directors are appointed in a separate process at one of these levels and are viewed as 
comparable to "Professors" (i.e. Department Heads) of University Departments. 


An interesting feature of the German system is that if a researcher gets an offer from a 
foreign country or from a German university, an appeal can be made to the Minister for 
a promotion to a higher grade or for a special salary increase. (This seems to be a 
subject for potential abuse, but if it is faked or done too often it could backfire badly!) 


The key to the German system is getting into it in the first place. The competition is 
very fierce. Promotion is based on review and assessment and is heavily loaded for 
research performance. Critics of the system argue that scientists of government research 
institutes are too much like university professors in their research aspirations. Much if 
not most of the research has little apparent relevance to current social issues and many 
are "hiding behind the skirts" of a few Nobel prize winners instead of doing something 
useful. 
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PEOPLE’S REPUBLIC OF CHINA 


In the People’s Republic of China the reward system was for a few years modelled after 
that of the USSR placing most emphasis on research productivity as measured by 
publications. More recently, emphasis has shifted to the "results": what happened to 
increase productivity or to achieve national goals. For example, a scientist who 
developed a technique that was widely used for increasing yield of cotton by spraying 
crops with plant hormones was given promotion and perquisites such as travel abroad. 


Seniority seems to be considered as almost synonymous with managerial ability, a 
Confucian sentiment perhaps, but not without some statistical merit. In any event, the 
essential guidelines for promotion are seniority and accomplishment as measured by 
"results". 


JAPAN 


In Japanese agriculture and fisheries research agencies, newly recruited university 
graduates are evaluated on the basis of their promise for research. After a two year 
period of “orientation” (somewhat like a post-doctoral in a government laboratory) and 
provided they perform adequately, they are then appointed to the first of five grades. 
At the lower grades, the emphasis is primarily on research performance as measured by 
publications with particular attention to and applicability of the findings. At the higher 
grades progressively greater emphasis is given to managerial ability. “Only rarely" is a 
promotion to the fifth level based on research performance alone and “only very rarely" 
to the fourth level on managerial ability. The system is thus designed to ensure that top 
level managers have a track record of research, but may not ensure that they have 
managerial talent. 


NORWAY 


The promotion system in Norway follows closely that for universities. Permanent 
positions are advertised and applicants are reviewed by peer committees with two 
internal and one external members for junior grades and one internal and two external 
members for senior grades. 
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Evaluation is based on similar criteria as for universities with publications most 
important but other activities considered, such as scientific cruises and advisory 
comunittees. 


In recent years there has been a tendency to place more emphasis on the relevance of 
the research, but this is done in the evaluation of the project rather than in the 
evaluation of the scientist. Thus, there is explicit support to those who propose to 
perform work deemed relevant to the organization. "In consequence, there are more 
opportunities for publications and other products of research that "may help an 
employee in career advancement." 


In the words of Stein Bie of Noragric, "there is de facto (but not de jure) very significant 
weight put on performance that is in the interest of the organization....those employees 
whose work has proven to increase the reputation and/or income of the organization 
will normally benefit from this in salary negotiations". 


The trends are therefore clear,..... But the actual legalities seem to lag a bit behind both 
the will of the employers and the acceptance of the unions”. 


Attachment O gives the correspondence. 


ICELAND 


The information received from Iceland concerned the criteria for promotion at 
universities and by inference these also apply to research scientists hired by government. 
Attachment P gives the documentation which is essentially similar to that for a Canadian 
university in recognizing research, teaching and administrative contributions in 
considering promotion. 
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APPENDIX H 


Interdepartmental Committees Involved 
in the Promotion of Research Scientists 








Steering Committee on the Management 
of Science and Technology 


Dr. K. Babcock ADM, Geological Survey of Canada, 
Energy, Mines and Resources 


Mr. N. Bhumgara DG, Science and Professional Services Directorate, 
Supply and Services Canada 


Dr. R. Breithaupt DG, Communications Research Center, Communications 
Technologies Research Branch, Department of Communications 


Dr. M. Brochu Secretary General, Natural Sciences and Engineering 
Research Council 

Mr. B. Carin ADM, Economic Policy and Trade Competitiveness Branch, 
Department of External Affairs 

Dr. A. Chisholm Science Advisor, Environment Canada 

Dr. P. Colgan Assoc. Dir. Programs Branch, 
Canadian Museum of Nature 

Dr. W. Doubleday A/ADM Science, Department of Fisheries and Oceans 

Ms E. Dowdeswell ADM, Atmospheric Environment Service, 


Environment Canada 


Dr. M. Everell ADM, Mineral and Energy Technology Sector, 
Energy, Mines and Resources 

Mr. K. Foster ADM, Personnel, Department of National Defence 

Mr. M. Francino DG, Economic Development Policy Branch, 


Department of Finance 


Mr. S. Gershberg Asst. Sec. Economic Programs Sector, 
Treasury Board Secretariat 


Mr. T. Lee ADM, Policy, Forestry Canada 
Dr. B. Morrissey ADM, Research, Agriculture Canada 


Mr. D. Mulcaster ADM Research, Department of Communications 


Mr 


Dr. 


. R. Paton 


. K. Peebles 


. G. Pokotylo 


. M. Rosenberg 


. H. Rothschild 


. W. Rowat 


_B. Salley 


. B. Sterparn 


C. Willis 


Deputy Sec. Administrative Policy Branch 
Treasury Board Secretariat 


Chief, Research and Development, Materiel Branch, 
Department of National Defence 


DG, Research and Development, Transport Canada 


ADM, Corporate Affairs and Legislative Policy 
Consumer and Corporate Affairs 


ADM, Science, Industry, Science and Technology 


Asst. Sec. Economic and regional Development Policy 
Privy Council Office 


Sr. ADM, Western Economic Diversification Canada 


Dir, Federal Research Directorate, 
Industry, Science and Technology 


V.P. Science, National Research Council 


Working Group on S&T Human Resources Management 


Dr. J.C. St.Pierre 


Mr. G. Moore 


Ms. D. Bertrand 


Ms. H. Smith 


Mr. D. Smith 


Dr. T. Jubb 


Dr. H. Eisenhauer 


Mr. B. Newnham 


Mr. G. Boyd 


Mrs. G. Danis 


Dr. L. Carlson 


Ms. S. Sudnikowicz 


Mr. K. Kirk 


Dr. S. Gunner 


Mr. M. Lajoie 


Ms. J. Larose 


DG, Central Experimental Farm, 
Agriculture Canada 


Personnel Advisor, Agriculture Canada 


Personnel Advisor, Human Resources Branch, 
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INTERDEPARTMENTAL ADVISORY ae 


FOR THE PROMOTION OF RESEARCH SCI 


worse 


TERMS OF REFERENCE 


BACKGROUND 


The Terms of Reference of the Interdepartfentali Advisory 
Committee for the Scientific Research Group ( ac) ensue from 
the following: 






(1) exchange of correspondence: 


\(Psc) and 
- (ZAC) i 


(a) 21 June 1974 to Messrs. J.J. Carso 
J.P. Connell (TBS) from J.D. Kays, 


(b) 27 June 1974 to J.D. Keys from J.J.| Carson; and 


(¢) 17 July 1974 to J. D. Keys fron J. P. Connell. 


(2) An April 1979 review by the IAC to reflect; the 
negotiated changes, from a performance la lock step 


pay plan. 


(3) A 1990 review of these Terms of Refgrence by the IAC, to 
reflect changes in the management of th blie Servica, 
under the regime of Increased Ministerial Authority and 
Accountability, and Public Service 3000. 


TERMS OF RFFERENCE 


In light of this last review, the memberg of $He IAC 
recommend that the Terms of Reference of thi ommittee be 
specified as follows: 


AUTHORITIES | 


These Terms of Reference do not in any way a bi the 
authority delegated to departments by fT Public Service 
Commission to make appointments to positions |¢lassified under 
the Research Scientist Sub-Group, or to appr ve promotions at 
the time of the annual promotion exercise. : 
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The IAC has the authority to: 


(a) determine the method(s) of self-regylation that will be 
used for the promotion of Research dcientists so that 
the conmunity as a whole adheres tothe brinieiple of 
merit for appointments and promotions. | 


| 
(b) In the case of small agencies or depart ants (defined as 
having fewer than 25 research sclientista) ,| review all 
appointments to levels 3 and 4 as w@¢ll as promotions 
within the sub-group, and make recoymendations to that 
department or agency as to the dispdsition of tha 
recommendation for promotion or appdgintment. 


(c) Review all recommendations for promgtion © levels 3 and 
4 which exceed departmental quotas, and ‘advise if they 
meet the criteria for promotion. Wien submitting a 
case(s), departments will submit the weakqst case(s) 
considered. | 

| 

(ad) Provide policy advice to Treasury Board, the Public 
Service Commission and member departments relating to 
the promotion process fur research ‘ese 


MEMBERSHIP | 


The LAC will be composed of a chairman from a scientific 
agency which is not one ot the employing departments. [It 
will have as members one senior management representative 
trom each of the major employing departments and, a 
representative from the Treasury Board Secretariat, the 
Public Service Commission and the Departhent of Industry, 
Science and Technology (Science Sector). Departmental 
representatives may be accompanied by a tepresentative from 
their department's Human Resources Sector. | 


Several departments are not represented on the IAC as they 
employ only small numbers of Research Scientists. A small 
employer should provide a representative to the annual IAC 
promotion meeting to support any recommehdation. 

UOTA | 
| 


Quotas for the group are set at 5% and 25% of the established 
person-year complement for Research Scientist Group 
positions, for the SE-RES 4 and SE-RES 3 levels respectively. 
Departments will not include in these a ted 


i ) | 
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(a) persons returning to the Research sotent s¢ Sub-Group 
from a position in the Management Category? or, 


(b) persons who have reached age 65. 


In calculating their quotas, departments will|include all 
research scientists on full, part-time, or term employment. 
Part-time oc term staff will be counted against the quota on 
a pro-rated basis according to the percen eles of the person- 
year they will use. 


ANNUAL MEETINGS 


The IAC will hold at least one annual ipl ted 
will review: 


at which it 












(a) All recommended promotions above departm 
with regard to productivity and other ac 
required for promotion by the classifica 
and recommend appropriate action to the 
Appropriate supporting documentation wil 

h 


nfal quotas, 
ievements 

ion standard, 
epartment. 

e presented 






(b) Any recommendation for promotion to the 
level submitted by a department or agenc 
research scientist population, and reco 


action to the department or agency. 


ith a small 


“hie 3 or 4 
appropriate 


end 


(c) Statistics on appointments or promotions y level, 
department and whether from inside of outsjde the public 
service. Statistics to be submitted. for| review by 
departments are outlined in Annex 1 attached. 


OTHER REVIEWS 


The IAC will at the Annual Meeting or ata Life deemed more 
appropriate: 


(a) Review the consistency of the processes within each 
employing department for the delegated appointed 
authority in respect of the Research Scientist Group. 

(b) Review and approve an annual reports on fhe results of 
the Annual Periodic Review, for distribution to all 
departments that employ members of the Research 
Scientist Sub-Group, and to the Treapury| 5 ard 
Secretariat, to the Public Service Cpmmissfon, and to 
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(c) 


OA ae 
Industry Science and Technology Canada. 


Assist the departmental IAC member or the Public Service 
Commission, when requested by the departmental or agency 
Member, in the review of an appointment to level 3 or 4 
from outside the public service. (Related to this is 
approval of Phd equivalency for new appointments to the 
Research Scientist Sub-Group. Such approvals are made 
within the employing department with the: advice and 
participation of the IAC member.) 


February 14, 1991 
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